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Abstract —To be considered for a 2015 IEEE Jack Keil Wolf 
ISIT Student Paper Award. In this paper, a modified extrin¬ 
sic information transfer (EXIT) chart analysis that takes into 
account the relation between mutual information (MI) and bit- 
error-rate (BER) is presented to study the convergence behavior 
of block Markov superposition transmission (BMST) of short 
codes (referred to as basic codes). We show that the threshold 
curve of BMST codes using an iterative sliding window decoding 
algorithm with a fixed decoding delay achieves a lower bound in 
the high signal-to-noise ratio (SNR) region, while in the low SNR 
region, due to error propagation, the thresholds of BMST codes 
become slightly worse as the encoding memory Increases. We 
also demonstrate that the threshold results are consistent with 
finite-length performance simulations. 

I. Introduction 

Spatially coupled low-density parity-check (SC-LDPC) 
codes are constructed by coupling together a series of 
L disjoint Tanner graphs of an underlying LDPC block 
code (LDPC-BC) into a single coupled chain and can be 
viewed as a type of LDPC convolutional code [1]. It was 
shown in [2,3] that the belief propagation (BP) decoding 
thresholds of SC-LDPC code ensembles are numerically in¬ 
distinguishable from the maximum a posteriori (MAP) de¬ 
coding thresholds of their underlying LDPC-BC ensembles. 
Subsequently, it was proven analytically that SC-LDPC code 
ensembles exhibit threshold saturation on memoryless binary- 
input symmetric-output channels under BP decoding [4]. Due 
to their excellent performance, SC-LDPC codes have received 
a great deal of attention recently (see, e.g., [5-10] and the 
references therein). 

The concept of spatial coupling is not limited to LDPC 
codes. Block Markov superposition transmission (BMST) of 
short codes [11,12], for example, is equivalent to spatial 
coupling of the subgraphs that specify the generator matrices 
of the short codes. Prom this perspective, BMST codes are 
similar to braided block codes [13], staircase codes [14], and 
spatially coupled turbo codes [15]. A BMST code can also 
be viewed as a serially concatenated code with a structure 
similar to repeat-accumulate-like codes [16]. The outer code 
is a short code, referred to as the basic code (not limited to 
repetition codes), that introduces redundancy, while the inner 
code is a rate-one block-oriented feedforward convolutional 
code (instead of a bit-oriented accumulator) that introduces 
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memory between transmissions. Hence, BMST codes typically 
have very simple encoding algorithms. To decode BMST 
codes, a sliding window decoding algorithm with a tunable 
decoding delay can be used, as with SC-LDPC codes. The 
construction of BMST codes is flexible [17], in the sense that it 
applies to all code rates of interest in the interval (0,1). Purther, 
BMST codes have near-capacity performance (observed by 
simulation) in the waterfall region of the bit-error-rate (BER) 
cruve and an error floor (predicted by analysis) that can be 
controlled by the encoding memory. 

On an additive white Gaussian noise channel (AWGNC), 
the well-known extrinsic information transfer (EXIT) chart 
analysis [18] can be used to obtain the threshold of LDPC- 
BC ensembles. In [19], a novel EXIT chart analysis was 
used to evaluate the performance of protograph-based LDPC- 
BC ensembles, and a similar analysis was used to And the 
thresholds of q-ary SC-LDPC codes with sliding window 
decoding in [9]. Unlike LDPC codes, the asymptotic BER 
of BMST codes with window decoding cannot be better 
than a corresponding genie-aided lower bound [11]. Thus, 
conventional EXIT chart analysis cannot be applied directly 
to BMST codes. In this paper, we propose a modified EXIT 
chart analysis, that takes into account the relation between 
mutual information (MI) and BER, to study the convergence 
behavior of BMST codes and to predict the performance in 
the waterfall region of the BER curve. We also show that the 
modified EXIT chart analysis of BMST codes is supported by 
finite-length performance simulations. 

II. SC-LDPC Codes VS. BMST Codes 

In this section, both SC-LDPC codes and BMST codes are 
described in terms of matrices for the purpose of showing their 
similarities (dualities) and differences. 

A. Protograph-Based SC-LDPC Codes 

A protograph-based SC-LDPC code ensemble can be con¬ 
structed from a protograph-based LDPC-BC code ensemble 
using the edge spreading technique [3], described here in 
terms of the base (parity-check) matrix representation of code 
ensembles. Let H be a [N — K) x N base matrix representing 
an LDPC-BC ensemble with design rate R = K/N. A 
terminated SC (convolutional) base matrix Bsc with coupling 
width (syndrome former memory) m and coupling length L 
can be constructed by applying the edge spreading technique 
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lifting operation is then applied to -Bsc by replacing each 
nonzero entry in Bsc with a randomly selected M x M per¬ 
mutation matrix' and each zero entry in Bsc with the M xM 
all-zero matrix, resulting in a terminated SC-LDPC code with 
constraint length Vs = {m + \)MN, where M (typically a 
large integer) is the lifting factor. The resulting SC-LDPC 
parity-check matrix Hsc of size {L + m){N — K)M x LNM 
is given by 


Hsc = 

■ HoiO) 
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where the blank spaces in Hqc correspond to zeros and the 
submatrices Hi{t) have size {N — K)M x NM, The 
design rate of the terminated SC-LDPC code ensemble is given 
by 


Rsc = 1 - 


{L m){N — K) 

Tn 


L + m, 

= 1- —{1-R), (2) 


which is slightly less than the design rate R = K/N of 
the uncoupled LDPC-BC ensemble due to the termination. 
However, this rate loss becomes vanishingly small as L ^ oo. 


B. BMST Codes 


In contrast to SC-LDPC codes, it is convenient to describe 
BMST codes using generator matrices. To describe a BMST 
code ensemble with coupling width (encoding memory) m and 
coupling length L, we start with an .L x {L + m) matrix 
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(3) 


which has constant weight to -I- 1 in each row. Now assuming 
that we want to construct a rate R = k/n code, we select a 
basic code with a kxn generator matrix G. Let 11 i {0 < i < 
to) be to -I- 1 randomly selected n x n permutation matrices. 
Then each nonzero entry Ai j in A is replaced with a k x n 
matrix Gllj-i and each zero entry in A is replaced with the 
kxn all-zero matrix, resulting in a BMST code of length 
{L + m)n and dimension Lk. The resulting generator matrix 
Gbmst of the BMST code is given by 

Gbmst = 

rG-fToG-TTi GJT„ n 

G-TTo G^^ Gn^ 

GHo Gn^ GUm 

L GHo Gn, GHm^ 


The rate of the BMST code is 

Lk L 

-Rbmst = 


{L -f m)n L + m 




(4) 


which is slightly less than the rate R = k/n of the basic code. 
However, similar to SC-LDPC codes, this rate loss becomes 
vanishingly small as L ^ oo. 

Though any code (linear or nonlinear) with a fast encoding 
algorithm and an efficient soft-in soft-out (SISO) decoding 
algorithm can be taken as the basic code, in this paper we focus 
on the use of the M-fold Cartesian product of a repetition 
code (RC) or a single parity-check (SPC) code as the basic 
code, resulting in a BMST-RC code or a BMST-SPC code, 
respectively. Let Gq be the K x N generator matrix of an RC 
code or an SPC code. The kxn generator matrix G of the 
basic code is then given by 

G = diag{Go, • • • , Go}, (5) 

^ ^ ^ 

M 

where diag {Gq, • • • , Gq} is a block diagonal matrix with Go 
on the diagonal, n = NM, and k = KM. 


C. Similarities and Differences 

From the previous two subsections, we see that both SC- 
LDPC codes and BMST codes can be derived from a small 
matrix by replacing the entries with properly-defined sub¬ 
matrices. We also see that the generator matrix Gbmst of 
BMST codes is similar in form to the parity-check matrix 
ffsc of SC-LDPC codes. SC-LDPC codes introduce memory 
by spatially coupling the parity-check matrices of the under¬ 
lying LDPC-BCs, while BMST codes introduce memory by 
spatially coupling the generator matrices of the basic code. 
Thus, BMST codes can be viewed as a type of spatially 
coupled code. Similar to SC-LDPC codes, where increasing 
the lifting factor M improves waterfall region performance, 
increasing the Cartesian product order M of BMST codes also 
improves waterfall region performance. But the error floors, 
which are solely determined by the encoding memory to (see 
Section III-A), cannot be lowered by increasing M. 


HI. Performance Analysis of BMST Codes 


’if the nonzero entry Bij > 1, it is replaced by a summation of Bij 
nonoverlapping randomly selected permutation matrices of size M x M. 


Throughout the paper, we consider binary phase-shift key¬ 
ing (BPSK) modulation over the binary-input AWGNC. In this 
















Fig. 1. Example of a window decoder with decoding delay d = 2 operating 
on the normal graph of a BMST code ensemble with m = 2 at times t = 
0 (solid blue), and t = 1 (dotted red). For each window position/time instant, 
the first decoding layer is called the target layer. 

section, we first discuss the problem that prevents the use 
of conventional EXIT chart analysis for BMST codes, and 
then we provide a modified EXIT chart analysis to study the 
convergence behavior of BMST codes with window decoding. 

A. Genie-Aided Lower Bound on BER 

Let pb = /bmst(76) be the BER performance function 
corresponding to a BMST code with encoding memory (cou¬ 
pling width) m and coupling length L, where pb is the BER 
and 76 = Eb/No is in dB. Let pb = /Basic (7b) be the BER 
performance function of the basic code. By assuming a genie- 
aided decoder, we have [11] 

/BMST(7b) > /Basic (7b-fl01ogio (TO-hl)-lOlogio (l + ^)). 

(6) 

where the term 10 logj^Q (m-|-1) depends on the encoding 
memory m and the term 10 log^Q (1 -I- m/L) is due to the rate 
loss. In other words, a maximum coding gain over the basic 
code of 101og]^g(m -P 1) dB in the low BER (high signal-to- 
noise ratio (SNR)) region is achieved for large L. Intuitively, 
this bound can be understood by assuming that a codeword in 
the basic code is transmitted m-\-l times without interference. 

B. A Modified EXIT Chart Analysis 

To describe density evolution, it is convenient to assume the 
all-zero codeword is transmitted and to represent the messages 
as log-likelihood ratios. The threshold of protograph-based 
LDPC codes can be obtained based on a protograph-based 
EXIT chart analysis [9,19] by determining the minimum 
value of the SNR Eb/Ng such that the MI between the 
a posteriori message at a variable node and an associated 
codeword bit (referred to as the a posteriori MI for short) 
goes to 1 as the number of iterations increases, i.e., the BER 
at the variable nodes tends to zero as the number of iterations 
tends to infinity. However, as shown in (6), the high SNR 
performance of BMST codes with window decoding cannot be 
better than the corresponding genie-aided lower bound, which 
means that the a posteriori MI of BMST codes does not tend 
to 1 as the number of iterations tends to infinity. Thus, the 
conventional EXIT chart analysis cannot be applied directly 
to BMST codes. 

Eor convenience, the MI between the a priori input and the 
corresponding codeword bit is referred to as the a priori MI, 
the MI between the extrinsic output and the corresponding 
codeword bit is referred to as the extrinsic MI, and the 


MI between the channel observation and the corresponding 
codeword bit is referred to as the channel MI. The analysis 
assumes that the interleavers Ili (0 < i < m) are arbitrarily 
large and random. 

BMST code ensembles can be represented by a Eorney-style 
factor graph, also known as a normal graph [20], where edges 
represent variables and vertices (nodes) represent constraints. 
All edges connected to a node must satisfy the specific 
constraint of the node. A full-edge connects to two nodes, 
while a half-edge connects to only one node. A half-edge is 
also connected to a special symbol, called a “dongle”, that 
denotes coupling to other parts of the transmission system (say, 
the channel or the information source) [20]. There are three 
types of nodes in the normal graph of BMST codes.^ 


Node [^: All edges (variables) connected to node H- 
must sum to zero. The message updating rule at node H- 
is similar to that of the check node in the factor graph 
of a binary LDPC code. The only difference is that the 
messages on the half-edges are obtained from the channel 
observations. 

Node [^: All edges (variables) connected to node 
must take the same (binary) value. The message updating 
rule at node is the same as that of the variable node 
in the fact or graph of a binary LDPC code. 

Node C : All edges (variables) connected to node C 


must satisfy the constraint specified the basic code. 
The message updating rule at node can be derived 
accordingly, where the messages on the half-edges are 
associated with the information source. 


The normal graph of a BMST code ensemble can be divided 
into laye rs, where each layer typically consists of a node of 
type C , a node of type [^, and a node of type [^. Similar to 
SC-LDPC codes, an iterative sliding window decoding EXIT 
chart analysis algorithm with decoding delay d working over 
a subgraph consisting of d -b 1 consecutive layers can be 
implemented to study the convergence behavior of BMST 
codes.^ The first layer in any window is called the target layer. 
An example of a window decoder with decoding delay d = 2 
operating on the normal graph of a BMST code ensemble with 
m = 2 is shown in Eig. 1. In our mo dified EXIT chart analysis, 
the convergence check at node C is performed as follows. 


Algorithm 1: Convergence Check at Node 


Let 1a denote the a priori MI and Ie denote the extrinsic 
MI. Then the a posteriori MI Iap is given by 


Zap = J{V[J-HIaW + [J-\IeW), (7) 


where the J(-) and functions are given in [21], I a 

is the a priori MI, and is the extrinsic MI. Suppose that 
the a posteriori MI is Gaussian. As shown in Section III- 
C of [18], an estimate of the BER pest is then given by 

Pest = Q{j~\l-lAp)/2), ( 8 ) 


^For more details on the normal realization of BMST codes, we refer the 
reader to [11,12], 

^As with SC-LDPC codes, the decoding delay d must be chosen several 
times as large as the encoding memory m in order to achieve good perfor¬ 
mance. 
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If the estimated BER pest is less than the preselected tar¬ 
get BER, a local decoding success is declared; otherwise, 
a local decoding failure is declared. 

Given a channel parameter Ei,/Nq, the channel MI is given 
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The modified EXIT chart analysis algorithm of BMST codes 
can now be described as follows. 

Algorithm 2: EXIT Chart Analysis of BMST Codes with 
Window Decoding 

• Initialization: All messages over those half-edges (con¬ 
nected to the channel) at nodes are initialized as Ich 
according to (10), all messages over those ha lf-ed ges 
(connected to the information source) at nodes 


initialized as 0, and all messages over the remaining 
(inter-connected) full-edges are initialized as 0. Set a 
maximum number of iterations /max > 0. 

Sliding window decoding: Eor each window position, 
the d + 1 decoding layers perform MI message process¬ 
ing/passing layer-by-layer according to the schedule 




vergence check at node C using Algorithm 1. If a 


local decoding failure is declared, then window decod¬ 
ing terminates; otherwise, a local decoding success is 
declared, the window position is shifted, and decoding 
continues. A complete decoding success for a specific 
channel parameter Eb/Ng and target BER is declared if 
and only if all target layers declare decoding successes. 

Now we can denote the iterative decoding threshold 
(Eb/No)* of BMST code ensembles for a preselected target 
BER as the minimum value of the channel parameter Eb/N q 
which allows the decoder of Algorithm 1 to output a decoding 
success, in the limit of large code lengths (i.e., M oo). 


IV. Numerical Results 

In the simulations to compute the window decoding thresh¬ 
olds of BMST codes, we set a maximum number of iterations 

/max = 1000. 

Example 1: In Eig. 2, we display the thresholds of several 
families of BMST code ensembles with increasing coupling 
length L, m < L < 1000, for a preselected target BER of 
10“^. The decoding delayis set to d = 3m. Eig. 2(a) plots 
the thresholds in terms of the standard deviation cr*^ of the 
noise against the ensemble code rate /(bmst- We observe that, 
as L increases, the rate also increases while the threshold 
(T*^ remains constant. The same thresholds are depicted in 
Eig. 2(b) in terms of the SNR {Eb/No)*. Since Eb/No takes 
into account the code rate, the thresholds (Eb/No)* improve 


"*The threshold does not improve further beyond a decoding delay d = 3m. 
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Eig. 2. AWGNC BP thresholds in terms of (a) standard deviation tr*^ and 
(b) SNR {Eb/No)* (dB) for several families of BMST code ensembles with 
increasing coupling length L, m < L < 1000, for a preselected target BER 
of 10-^. 

monotonically with increasing L. However, in both plots, we 
can see that the gap to capacity decreases as L increases. 

Example 2: Eor the coupling length L = 1000, we cal¬ 
culated BP thresholds for several families of BMST code 
ensembles with different preselected target BERs. The cal¬ 
culated thresholds in terms of the SNR (Eb/No)* versus the 
preselected target BERs together with the lower bounds are 
shown in Eig. 3, where we observe that 

1) Eor a fixed encoding memory m, the thresholds remain 
constant at a value near capacity. Once a critical target 
BER is reached, however, the thresholds degrade rapidly 
as the target BER decreases further. 

2) Eor a high target BER (roughly above 10“^), the 
threshold increases slightly as the encoding memory 
m increases, due to errors propagating to successive 
decoding windows. 

3) Eor a small decoding delay (say d = m), the thresholds 
do not achieve the lower bounds even in the high SNR 
region. 

4) Eor a larger decoding delay (say d = 3m), the thresholds 
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Fig. 3. AWGNC BP thresholds in terms of {Ei,/No)* (dB) for several 
families of BMST codes ensembles with different target BERs. The finite- 
length performance of BMST codes with RC and SPC [4,3]^®'"' 

as basic codes is also included. The coupling length L = 1000. 

correspond to the lower bounds in the high SNR region, 
suggesting that the window decoding algorithm is near 
optimal for BMST codes. 

5) The error floor can be lowered by increasing the encod¬ 
ing memory m (and hence the decoding delay d). 

In Fig. 3, the window decoding performance of BMST codes 
with RC [2,1]®'’™ and SPC [4,3]^®°° as basic codes is 
also plotted. By comparing the thresholds to the finite-length 
code performance, we conclude that the modified EXIT chart 
analysis for BMST codes is supported by the finite-length 
performance simulations. Note also that the gap between the 
simulated curves and the thresholds increases as the Cartesian 
product order M of BMST codes decreases, as expected. 


V. Conclusions 

In this paper, we have proposed a modified EXIT chart 
analysis, that takes into account the relation between the MI 
and the BER, to calculate the window decoding thresholds of 
BMST codes. In this analysis, a BP algorithm is performed on 
the corresponding high-level normal graph of a BMST code 


ensemble. Using the modified EXIT chart analysis, we can 
predict the performance of BMST codes in the waterfall region 
of the BER curve. Einally, we showed that the EXIT chart 
analysis results are consistent with finite-length performance 
simulations. 


References 

[1] A. J. Felstrom and K. S. Zigangirov, “Time-varying periodic convo¬ 
lutional codes with low-density paiity-check matrix,” IEEE Trans. Inf. 
Theory, vol. 45, no. 6, pp. 2181-2191, Sept. 1999. 

[2] M. Lentmaier, A. Sridharan, D. J. Costello, Jr., and K. S. Zigangirov, 
“Iterative decoding threshold analysis for LDPC convolutional codes,” 
IEEE Trans. Inf. Theory, vol. 56, no. 10, pp. 5274-5289, Oct. 2010. 

[3] D. G. M. Mitchell, M. Lentmaier, and D. J. Costello, Jr., 
“Spatially coupled LDPC codes constructed from protographs,” 
2014, submitted to IEEE Trans. Inf. Theory. [Online]. Available: 
http ://arxiv. org/ abs/1407.5366. 

[4] S. Kudekar, T. J. Richardson, and R. L. Urbanke, “Spatially coupled 
ensembles universally achieve capacity under belief propagation,” IEEE 
Trans. Inf. Theory, vol. 59, no. 12, pp. 7761-7813, Dec. 2013. 

[5] A. E. Pusane, R. Smarandache, P. O. Vontobel, and D. J. Costello, Jr., 
“Deriving good LDPC convolutional codes from LDPC block codes,” 
IEEE Trans. Inf. Theory, vol. 57, no. 2, pp. 835-857, Feb. 2011. 

[6] A. R. Iyengar, M. Papaleo, P. H. Siegel, J. K. Wolf, A. Vanelli-Coralli, 
and G. E. Corazza, “Windowed decoding of protograph-based LDPC 
convolutional codes over erasure channels,” IEEE Trans. Inf. Theory, 
vol. 58, no. 4, pp. 2303-2320, Apr. 2012. 

[7] I. Andriyanova and A. Graell i Amat, “Threshold saturation 

for nonbinary SC-LDPC codes on the binary erasure channel,” 
2013, submitted to IEEE Trans. Inf. Theory. [Online]. Available: 

http://arxiv.org/abs/1311.2003 

[8] D. G. M. Mitchell, A. E. Pusane, and D. J. Costello, Jr., “Minimum 
distance and trapping set analysis of protograph-based LDPC convolu¬ 
tional codes,” IEEE Trans. Inf. Theory, vol. 59, no. 1, pp. 254—281, Jan. 

2013. 

[9] L. Wei, D. G. M. Mitchell, T. E. Fuja, and D. J. Costello, Jr., “Design 
of spatially coupled LDPC codes over GF(g) for windowed decoding,” 

2014, submitted to IEEE Trans. Inf. Theory. [Online]. Available: 

http://arxiv.org/abs/1411.4373 

[10] K. Huang, D. G. M. Mitchell, L. Wei, X. Ma, and D. J. Costello, Jr., 
“Performance compaiison of LDPC block and spatially coupled codes 
over GF(g),” IEEE Trans. Commun., 2015, to appear. 

[11] X. Ma, C. Liang, K. Huang, and Q. Zhuang, “Block Mai'kov 

superposition transmission: Constmction of big convolutional codes 
from short codes,” 2013, submitted to IEEE Trans. Inf. Theory. 

[Online]. Available: http://arxiv.org/abs/1308.4809 

[12] C. Liang, X. Ma, Q. Zhuang, and B. Bai, “Spatial coupling of generator 
matrices: A general approach to design good codes at a target BER,” 
IEEE Trans. Commun., vol. 62, no. 12, pp. 4211-4219, Dec. 2014. 

[13] A. J. Feltstrom, D. Truhachev, M. Lentmaier, and K. S. Zigangirov, 
“Braided block codes,” IEEE Trans. Inf. Theory, vol. 55, no. 6, pp. 
2640-2658, June 2009. 

[14] B. P. Smith, A. Farhood, A. Hunt, F. R. Kschischang, and J. Lodge, 
“Staircase codes: FEC for 100 Gb/s OTN,” J. Lightwave Technol, 
vol. 30, no. 1, pp. 110-117, Jan. 2012. 

[15] S. Moloudi, M. Lentmaier, and A. Graell i Amat, “Spatially coupled 
turbo codes,” in Proc. Int. Symp. Turbo Codes Iterative Inf. Process., 
Bremen, Germany, Aug. 2014. 

[16] A. Abbasfar, D. Divsalar, and K. Yao, “Accumulate-repeat-accumulate 
codes,” IEEE Trans. Commun., vol. 55, no. 4, pp. 692-702, Apr. 2007. 

[17] C. Liang, J. Hu, X. Ma, and B. Bai, “A new class of multiple- 
rate codes based on block Markov superposition transmission,” 
2014, submitted to IEEE Trans. Signal Process. [Online]. Available: 
http ://arxiv. org/ abs/1406.2785 

[18] S. ten Brink, “Convergence behavior of iteratively decoded parallel 
concatenated codes,” IEEE Trans. Commun., vol. 49, no. 10, pp. 1727— 
1737, Oct. 2001. 

[19] G. Liva and M. Chiani, “Protograph LDPC codes design based on EXIT 
analysis,” in Proc. IEEE Global Commun. Conf, Washington, DC, Nov. 
2007. 

[20] G. D. Forney Jr., “Codes on graphs: Normal realizations,” IEEE 
Trans. Inform. Theory, vol. 47, no. 2, pp. 520-548, Feb. 2001. 

[21] S. ten Brink, G. Ki'amer, and A. Ashikhmin, “Design of low-density 
parity-check codes for modulation and detection,” IEEE Trans. Com¬ 
mun., vol. 52, no. 4, pp. 670-678, Apr. 2004. 


































